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[57] ABSTRACT 

An ultrasonic imaging system and method acquire funda- 
mental mode and harmonic mode ultrasonic image signals 
with a transducer from a subject under examination. These 
image signals are then combined to form a composite image. 
This composite image includes two lateral edgefield image 
regions modulated primarily as a function of the fundamen- 
tal mode ultrasonic image signals, and a centerfield image 
region modulated primarily as a function of the harmonic 
mode image signals. In this way, improved image quality 
can be obtained throughout the imaged field of view. 
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MEDICAL DIAGNOSTIC ULTRASONIC 
IMAGING SYSTEM AND METHOD FOR 
DISPLAYING COMPOSITE FUNDAMENTAL 
AND HARMONIC IMAGES 

BACKGROUND 

This invention relates to ultrasonic imaging systems and 
methods, and particularly to ultrasonic imaging systems and 
methods that utilize both harmonic and fundamental imag- 
ing modes. 

Ultrasonic imaging systems that combine ultrasonic 
images from multiple transmit beams to form a single 
improved image are described for example in U.S. Pat. Nos. 
5,568,813; 5,111,824; 5,462,057; and 5,579,770. The meth- 
ods described in these patents however do not address the 
issue of providing high image quality in harmonic images of 
technically difficult examinations. 

Hossack et al. U.S. patent application Ser. No. 08/904, 
825, assigned to the assignee of the present invention, 
discloses a method and system that combine nearfield har- 
monic imaging and farfield fundamental imaging to create a 
single improved image. This application also discloses a 
system and method that combine a nearfield image which is 
an amplitude matched combination of fundamental and 
harmonic signals with a farfield fundamental image to form 
a single improved image. 

Danhua Zhao U.S. Pat. No. 5,897,500, assigned to the 
assignee of the present invention, discloses a method and 
system that combines nearfield fundamental imaging and 
middle field or farfield imaging to create a single composite 
image. In one system and method, nearfield and farfield 
regions are modulated primarily as a function of fundamen- 
tal mode image signals and a middlefield region is modu- 
lated primarily as a function of harmonic mode image 
signals. 

In spite of the improvements provided in the above 
identified Hossack and Danhua Zhao applications, a need 
presently exists for an ultrasonic imaging system and 
method that provide improved lateral imaging, particularly 
for use in harmonic imaging systems used to image tissue 
without added contrast agent. In such cases, particularly in 
technically difficult examinations, the lateral performance 
may be less than optimum because of degradation of image 
signals along edge lines. For example, the signal to noise 
ratio decreases along edge lines for vector and sector scan 
formats. 

SUMMARY 

The present invention is defined by the following claims, 
and nothing in this section should be taken as a limitation on 
those claims. By way of introduction, it can be stated that the 
method and apparatus described below acquire fundamental 
mode ultrasonic image signals and harmonic mode ultra- 
sonic image signals from a subject. The fundamental and 
harmonic mode image signals are combined to form a 
composite image, which includes rightfield and leftfield 
image regions that are modulated primarily as a function of 55 
the fundamental mode ultrasonic image signals, and a cen- 
terfield image region that is modulated primarily as a 
function of the harmonic mode ultrasonic image signals. By 
using the fundamental mode image signals preferentially in 
the rightfield and leftfield, image quality is enhanced while 60 
the detail resolution and improved reduction in image clutter 
artifact associated with harmonic imaging is maintained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of an ultrasonic imaging system 65 
that incorporates a presently preferred embodiment of this 
invention. 
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FIG. 2 is a schematic diagram of a vector scan pattern. 

FIG. 3 is a schematic diagram of a composite image 
generated with the system of FIG. 1. 

FIGS. 4 and 5 are graphs of fundamental and harmonic 
weighting functions, respectively, used in the formation of 
the image of FIG. 3. 

FIG. 6 is a block diagram of a method practiced by the 
system 10 of FIG. 1. 

FIG. 7 is a block diagram of another ultrasonic imaging 
system that incorporates a preferred embodiment of this 
invention. 

DETAILED DESCRIPTION OF THE 
PRESENTLY PREFERRED EMBODIMENT 

Turning now to the drawings, FIG. 1 shows a block 
diagram of a medical ultrasonic imaging system 10 that 
provides improved image quality by combining leftfield 
fundamental, centerfield harmonic, and rightfield fundamen- 
tal images together to create a composite image providing 
improved signal to noise ratio and consistent enhanced detail 
resolution in the lateral dimension. 

The system 10 includes a transmit beamformer 12, a 
transmit/receive switch 14, a phased transducer array 16, a 
receive beamformer 24, a filter 26, a scan converter 30, and 
a display 32. The transmit beamformer 12 generates shaped 
transmit waveforms so that the transmitted harmonic fre- 
quency power is suppressed. Unshaped waveforms may also 
be used. The receive beamformer 24 is operative to form an 
acoustic beam at either the received fundamental frequency, 
or at a harmonic of the received fundamental frequency, 
such as the second harmonic for example. The filter 26 is 
adjustable to pass either the fundamental signals or the 
harmonic signals, such as a bandpass filter or a demodulator 
and low pass filter. By passing either fundamental or har- 
monic signals, the system 10 operates in a fundamental or a 
harmonic mode. The scan converter 30 is operative to store 
at least two received acoustic beams and to splice them into 
a single scan line as described below. 

FIG. 2 is a schematic diagram of a vector scan pattern. 
Each transmitted waveform is focused along one of a 
plurality of N scan lines 34. The received acoustic beams are 
also focused along the scan lines 34. Multiple foci along any 
or all the scan lines 34 may be used. Information along each 
entire scan line 34 is obtained. An entire scan line comprises 
information along a range of depths used to generate an 
image. 

The scan lines 34 are formatted to image an area or region 
36 of a subject. As shown, the region 36 is imaged with a 
vector format where the scan lines 34 (1 through N) vary by 
different angles. The further towards a lateral edge 38, the 
greater the angle relative to a normal from the transducer 
array 16 (FIG. 1). Different angular relationships between 
various scan lines and between scan lines and the transducer 
array 16 (FIG. 1) may be used. In alternative embodiments, 
sector, curved vector, linear, curver linear or other formats 
are used. 

FIG. 3 is a schematic diagram of a composite image 40 
formed on the display 32 of FIG. 1. The image 40 includes 
five separate regions: a leftfield region 42, a centerfield 
region 46, a rightfield region 50, a leftfield compounded 
region 44, and a rightfield compounded region 48. The terms 
leftfield, centerfield, and rightfield are not intended to define 
any specific scan lines or lateral dimensions. Rather, these 
terms define relative scan line positions or lateral 
dimensions, with the leftfield region 42 being further left on 
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the image than the rightfield region 50. The rightfield region 
42 and leftfield region 50 comprise edgefields that are 
adj acent a lateral edge or closer to a lateral edge of the image 
40 than the centerfield region 46 

Additional or different regions may be used with or 
without compounded regions. For example, a composite 
image associated with only two laterally divided regions, 
one modulated as a function of harmonic information and 
the other modulated as a function of fundamental 
information, may be generated. 

The system 10 generates a series of fundamental beams 
for regions associated with fundamental information, such 
as the leftfield region 42, rightfield region 50, leftfield 
compounded region 44 and rightfield compounded region 
48. The system 10 also generates a series of harmonic beams 
for regions associated with harmonic information, such as 
the centerfield region 46, leftfield compounded region 44 
and rightfield compounded region 48. As discussed below, 
the rightfield and leftfield regions 42 and 50 may also 
include some harmonic information and the centerfield 
region 46 may also include some fundamental information. 

The system 10 combines harmonic and fundamental 
information associated with the same scan line 34. Two 
piece -wise linear weighting functions as shown in FIGS. 4 
and 5 control the combination. The fundamental weighting 
function 60 of FIG. 4 has a magnitude of zero in the 
centerfield region 46, such as associated with scan line 
angles of 0 through 20 degrees. The function 60 increases 
linearly from 0 to 0.75 in the rightfield and leftfield com- 
pounded regions 44 and 48, such as associated with scan line 
angles of 21 through 35 degrees. The function 60 remains at 
0.75 for the leftfield and rightfield regions 42 and 50, such 
as associated with scan lines angles greater than 35 degrees. 
Although the function 60 is shown as a linear function in the 
two compounded regions in FIG. 4, nonlinear functions can 
also be used. Furthermore, different angles may be used for 
the beginning and ending of the compounded regions 44 and 
48, and different angles or functions may be used for the 
leftfield compounded region 44 than for the rightfield com- 
pounded region 48. 

The harmonic weighting function 62 of FIG. 5 is formed 
by subtracting the function 60 from 1 and clipping the 
minimum to 0.25, such that the sum of the two weighting 
functions 60, 62 is equal to 1.0 for scan line angles of 0 
through 45 degrees. In alternative embodiments, the har- 
monic weighting function 62 is not clipped, is clipped at a 
different angle or magnitude, or is not related to the funda- 
mental weighting function 60 as a function of subtraction 
from 1. 

In an alternative embodiment, the percentage or weight of 
the harmonic information varies linearly from 100% for a 
scan line angle of 0 degrees to 10% for a scan line angle of 

45 degrees. The percentage or weight of the fundamental 
information varies linearly from 0% for a scan line angle of 
0 degrees to 90% for a scan line angle of 45 degrees. Other 
angles and nonlinear relationships may be used. In this 
embodiment, the rightfield and leftfield regions 50 and 42 
are associated with information modulated primarily as a 
function of fundamental information, such as a fundamental 
weight of 75% or more. Conversely, the centerfield region 

46 is associated with information modulated primarily as a 
function of harmonic information, such as a harmonic 
weight of 75% or more. Other weights, larger or smaller than 
75%, may be used. 

The fundamental and harmonic beams are combined in 
the scan converter by multiplying the fundamental beam by 
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the fundamental weighting function 60 of FIG. 4, multiply- 
ing the harmonic beam by the harmonic weighting function 
62 of FIG. 5, and then summing the weighted fundamental 
and harmonic beams to create a composite beam that is used 
for display purposes. 

This method practiced by the system 10 in forming the 
composite image 40 is flow charted in FIG. 6. As shown in 
step 76, the first step in this method is to acquire the required 
image signals. In this case two separate image signals are 
acquired, each along the same lateral direction. The first 
image signal F is a fundamental mode image signal. The 
second image signal H is a harmonic mode image signal. 

The next step 78 in the method of FIG. 6 is a combining 
step which includes two component parts. First, the two 
image signals F and H acquired in step 76 are weighted or 
multiplied by weighting functions 60 and 62, respectively, as 
shown in FIGS. 4 and 5. The final portion of the combining 
step 78 is to sum the weighted image signals F and H to form 
the composite image signal that is displayed. The method is 
then continued with the other sets of image signals as 
appropriate to obtain the composite image signals for the 
each position along the scan line 34 and for other scan lines 
34. 

The acquiring step 76 is performed by the elements 12 
through 26 of FIG. 1, and the combining step 78 of FIG. 6 
is performed by the scan converter 30 of FIG. 1. 

FIG. 7 is a block diagram of another ultrasonic imaging 
system 80 that can be used to practice alternative embodi- 
ments of this invention. The system 80 includes a transmit 
beamformer 12, a transmit/receive switch 14, and a trans- 
ducer array 16 as described above. 

The system 80 also includes two separate receive beam- 
formers 86, 88 in parallel. The receive beamformer 86 forms 
a receive beam at the fundamental frequency F 0 , while the 
receive beamformer 88 forms a receive beam at a second 
harmonic frequency 2F 0 . The fundamental and harmonic 
receive beams are applied to parallel filters 90, 92, 
respectively, before they are combined in the scan converter 
94. The combined signal is then supplied for display on the 
display 32. Because both the fundamental and the receive 
beams are acquired from the same transmit event, the system 
80 improves frame rates and reduces motion artifacts as 
compared to the system 10 of FIG. 1. 

The embodiments described above provide the advan- 
tages of improved lateral edge field imaging performance. 
This improvement in edgefield imaging performance results 
in an overall image quality that is improved and preserved 
throughout the lateral dimension. 

In an alternate embodiment, the composite image 40 also 
includes the nearfield, farfield and/or middlefield regions 
discussed in U.S. applications, Ser. Nos. 08/993,947 and 
08/638,918. The composite image 40 may include a center 
region modulated primarily as a function of harmonic image 
signals surrounded azimuthally and laterally by nearfield, 
farfield, leftfield and rightfield regions modulated primarily 
as a function of fundamental image signals. Compounded 
regions may also be included. 

In other alternative embodiments, any of the regions are 
associated with information combined as a function of a 
plurality of types of information. For example, the center- 
field region is responsive to a combination of information 
associated with second and third harmonics. Other fre- 
quency bands may be used. 

Of course the present invention can be implemented in 
many other ways. The harmonic and fundamental mode 
image signals can be acquired using the widest variety of 
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filtering and demodulation techniques. Transmit focal length 
can be varied as desired, and both single and multiple 
transmit focus techniques can be used. The multiple image 
signals combined to form the composite image signal can be 
obtained in parallel or sequentially. Various beamformers, 
filters and the like can be used, including those employing 
analog and digital signal processing techniques. 

Similarly, the image signals can be combined to form the 
composite image signal using many techniques, including 
look up tables and analog or digital circuits for scaling and 
summing signals. The combining step can be performed at 
any desired point in image signal processing after beam 
formation, and the compounded regions discussed above are 
not required in all applications. 

This invention can be used both with and without the 
addition of contrast agent to the region being imaged. When 
contrast agent is added, it can be of any suitable type, 
including a variety of microbubbles. Particular advantages 
are obtained when no contrast agent is added to the region 
of interest throughout the imaging session, which may 
correspond to a medical diagnostic examination. In this case, 
the harmonic signal return from the edgefield portion of the 
imaged region is particularly weak, and improved edgefield 
images are obtained by using the fundamental image signal 
for the edgefield region as discussed above. 

As used herein, the terms fundamental and harmonic 
mode image signals are intended broadly. Fundamental 
mode image signals are formed primarily in response to 
ultrasonic echoes at the same ultrasonic frequency as the 
dominant transmitted ultrasonic frequency. Harmonic mode 
ultrasonic image signals are formed primarily in response to 
ultrasonic echoes having a frequency different from that of 
the dominant transmitted ultrasonic frequency. The term 
harmonic is intended broadly to encompass subharmonics, 
fractional harmonics, and integral harmonics of two or 
greater. Second harmonic image modes have been found to 
be particularly useful in clinical applications. 

As pointed out above, the term lateral edgefield is 
intended to signify a portion of the imaged tissue left or right 
from the center or another portion of the image. The absolute 
ranges may vary broadly. 

When an imaged region is said to be modulated primarily 
as a function of a fundamental or a harmonic image signal, 
the term primarily is intended broadly to include image 
regions that are modulated solely or mostly as a function of 
the respective harmonic or fundamental signals. When an 
imaged region is said to be modulated as a function of a 
fundamental or a harmonic image signal, the term modula- 
tion is intended broadly to include image regions that are 
responsive solely to the fundamental or harmonic signals, 
respectively, or one of the respective fundamental or har- 
monic signals and other signals, such as respective harmonic 
and fundamental signal. For example, an image region 
modulated as a function of a harmonic signal may also be 
responsive to fundamental information (e.g., 50% harmonic 
and 50% fundamental). 

The foregoing detailed description has described only a 
few of the many forms that the present invention can take. 
For this reason, this detailed description is intended as an 
illustration of specific forms of the invention, and not as a 
definition of the invention. It is only the following claims, 
including all equivalents, that are intended to define the 
scope of this invention. 
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We claim: 

1. An ultrasonic imaging method comprising the follow- 
ing steps: 

(a) acquiring fundamental mode ultrasonic image signals 
and harmonic mode ultrasonic image signals with a 
transducer; 

(b) combining the fundamental and harmonic mode image 
signals of step (a) to form a composite image, said 
composite image comprising a first image region that is 
modulated as a function of the fundamental mode 
ultrasonic image signals and a second image region that 
is modulated primarily as a function of the harmonic 
mode ultrasonic image signals, the first image region 
being along entire scan lines at a lateral edge portion of 
the composite image and the second image region 
being along entire scan lines at a center portion of the 
composite image. 

2. The method of claim 1 wherein the composite image 
formed in step (b) further comprises a third, lateral edgefield 
region that is modulated as a function of the fundamental 
mode ultrasonic signals. 

3. The method of claim 1 wherein the composite image 
formed in step (b) further comprises a compounded region 
intermediate the first and second image regions, said com- 
pounded region modulated as a function of both the funda- 
mental mode image signals and the harmonic mode image 
signals, and said first region modulated primarily as a 
function of the fundamental mode ultrasonic image signals. 

4. The method of claim 2 wherein the composite image 
formed in step (b) further comprises first and second com- 
pounded regions, said first compounded region intermediate 
the first and second image regions, said second compounded 
region intermediate the second and third image regions, said 
first and second compounded regions modulated as respec- 
tive functions of both the fundamental mode image signals 
and the harmonic mode image signals, and said third region 
modulated primarily as a function of the fundamental mode 
image signals. 

5. The method of claim 1 wherein step (a) comprises the 
step of acquiring the fundamental mode and harmonic mode 
ultrasonic image signals in a sector scan format. 

6. The method of claim 1 wherein step (a) comprises the 
step of acquiring the fundamental mode and the harmonic 
mode ultrasonic image signals in a format selected from the 
group consisting of: linear, vector and curved vector. 

7. The method of claim 1 wherein step (a) is performed 
during an ultrasonic medical diagnostic examination 
session, further comprising the step of (c) maintaining the 
subject free of added contrast agent throughout the exami- 
nation session. 

8. The method of claim 1 wherein step (a) comprises the 
step of acquiring at least some of the fundamental and the 
harmonic mode image signals in parallel. 

9. A medical ultrasonic diagnostic imaging system 
adapted to provide a composite image comprising: 

a first image region modulated as a function of funda- 
mental mode ultrasonic image signals acquired along 
entire scan lines at a lateral edgefield portion of the 
composite image; 

a second image region modulated primarily as a function 
of harmonic mode ultrasonic image signals acquired 
along entire scan lines at a centerfield portion of the 
composite image. 

10. An ultrasonic imaging system comprising: 

means for acquiring fundamental mode ultrasonic image 
signals and harmonic mode ultrasonic image signals 
with a transducer; 
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means for combining the fundamental and harmonic 
mode image signals to form a composite image, said 
composite image comprising a first image region that is 
modulated as a function of the fundamental mode 
ultrasonic image signals and a second image region that 5 
is modulated primarily as a function of the harmonic 
mode ultrasonic image signals, the first image region 
being along entire scan lines at a lateral edge portion of 
the composite image and the second image region 
being along entire scan lines at a center portion of the 10 
composite image. 

11. The invention of claims 9 or 10 wherein the composite 
image is associated with a scan format selected from the 
group consisting of: linear, sector, curved vector and vector. 

12. The invention of claims 9 or 10 wherein the first and 15 
second image regions comprise centerfield and rightfield 
regions, respectively, of the composite image. 

13. The invention of claims 9 or 10 wherein the first and 
second regions comprise centerfield and leftfield regions, 
respectively, of the composite image. 20 

14. The invention of claim 13 wherein the composite 
image further comprises a third, rightfield region that is 
modulated as a function of the fundamental mode ultrasonic 
image signals. 

15. The method of claim 14 wherein the composite image 25 
further comprises first and second compounded regions, said 
first compounded region intermediate the first and second 
image regions, said second compounded region intermediate 
the second and third image regions, said first and second 
compounded regions modulated as respective functions of 30 
both the fundamental mode image signals and the harmonic 
mode image signals, and said first and third regions modu- 
lated primarily as a function of the fundamental mode 
ultrasonic image signals. 

16. The invention of claims 9 or 10 wherein the composite 35 
image further comprises a compounded region, intermediate 
the first and second image regions, said compounded region 
modulated as a function of both the fundamental mode 
image signals and the harmonic mode image signals, and the 
first image region modulated primarily as a function of the 40 
fundamental mode ultrasonic image signals. 

17. The invention of claim 10 wherein the acquiring 
means comprises means for acquiring the fundamental and 
harmonic mode image signals sequentially. 

18. The invention of claim 10 wherein the acquiring 45 
means comprises means for acquiring the fundamental and 
harmonic mode image signals in parallel. 

19. The invention of claims 1, 9 or 10 wherein the first 
region is modulated substantially only as a function of the 
fundamental mode ultrasonic image signals, without any 50 
substantial contribution from the harmonic mode ultrasonic 
image signals. 

20. The invention of claims 1, 9 or 10 wherein the second 
region is modulated substantially only as a function of the 
harmonic mode image signals, without any substantial con- 55 
tribution from the fundamental mode ultrasonic image sig- 
nals. 

21. The invention of claims 1, 9 or 10 wherein the 
fundamental and harmonic mode ultrasonic image signals 
contribute at least 75% and at most 25%, respectively, to the 60 
first region and the fundamental and harmonic mode ultra- 
sonic image signals contribute at most 25% and at least 75%, 
respectively, to the second region. 

22. An ultrasonic imaging method comprising the follow- 
ing steps: 
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(a) acquiring fundamental mode ultrasonic image signals 
and harmonic mode ultrasonic image signals with a 
transducer; 

(b) combining the fundamental and harmonic mode image 
signals of step (a) to form a composite image, said 
composite image comprising a first image region that is 
modulated as a function of the fundamental mode 
ultrasonic image signals, a second image region that is 
modulated primarily as a function of the harmonic 
mode ultrasonic image signals, a compound image 
region that is modulated as a function of both the 
fundamental mode image signals and the harmonic 
mode image signals, the first image region being at a 
lateral edge portion of the composite image, the second 
image region being at a center portion of the composite 
image and the compound region being intermediate of 
the first and second image regions. 

23. The method of claim 22 wherein the composite image 
formed in step (b) further comprises a third, lateral edgefield 
region that is modulated as a function of the fundamental 
mode ultrasonic image signals. 

24. The method of claim 23 wherein the composite image 
formed in step (b) further comprises a second compound 
region that is modulated as a function of both the funda- 
mental mode image signals and the harmonic mode image 
signals, said second compound region intermediate the 
second and third image regions, and said first and third 
regions modulated primarily as a function of the fundamen- 
tal mode ultrasonic image signals. 

25. The method of claim 22 wherein step (a) is performed 
during an ultrasonic medical diagnostic examination 
session, further comprising the step of (c) maintaining the 
subject free of added contrast agent throughout the exami- 
nation session. 

26. The method of claim 22 wherein the composite image 
formed in step (b) further comprises azimuthal nearfield and 
farfield regions that are each modulated as a function of one 
of fundamental and harmonic mode image signals. 

27. A medical ultrasonic diagnostic imaging system 
adapted to provide a composite image comprising: 

a first image region modulated as a function of funda- 
mental mode ultrasonic image signals acquired at a 
lateral edgefield portion of the composite image; 

a second image region modulated primarily as a function 
of harmonic mode ultrasonic image signals acquired at 
a centerfield portion of the composite image; and 

a compounded region, intermediate the first and second 
image regions, said compounded region modulated as 
a function of both the fundamental mode image signals 
and the harmonic mode image signals. 

28. The method of claim 27 wherein the composite image 
further comprises: 

a third image region modulated as a function of funda- 
mental ultrasonic image signals at a second lateral 
edgefield portion of the composite image; and 

a second compounded regions, said second compounded 
region intermediate the second and third image regions, 
said second compounded regions modulated as respec- 
tive functions of both the fundamental mode image 
signals and the harmonic mode image signals. 



